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The Concurrent Validity of Six Personality 
and Adjustment Tests for Children 


Louis M. SmitrH! 


HE present study investigates the va- 

lidity of six personality and adjust- 
ment tests for children. In the terminol- 
ogy of the recent publication by the 
American Psychological Association Com- 
mittee on Test Standards, the approach is 
one of “concurrent validity.” The com- 
mittee’s report states: 

Concurrent validity is evaluated by showing 
how well test scores correspond to measures 
of concurrent criterion performance or status. 
Studies which determine whether a test dis- 
criminates between presently identifiable groups 
are concerned with concurrent validity (2, p. 14). 
More specifically, this investigation indi- 
cates the relationship of the tests to a 
dual standard—teacher nominations of 
very well adjusted and very poorly ad- 
justed children and peer nominations of 
classmates liked and classmates with 
whom one does not get along. 

Three of the six tests are widely used 
instruments: California Test of Person- 
ality (52), Rosenzweig Picture-Frustra- 
tion Study (43), and Rogers Test of Per- 
sonality Adjustment (41, 42). Three are 
recently developed and as yet unpub- 
lished: How I Feel About Things, How 
Would You Finish It, and Things I Like 


‘This report is based on a dissertation sub- 
mitted to the University of Minnesota in partial 
fulfillment of the requirements for the degree of 
Doctor of Philosophy, December 1955. The 
writer wishes to express his thanks to Mildred 
femplin and Ralph Berdie, his thesis advisers, 
for their helpful criticisms and suggestions. 
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To Do (4, 5, 6). All six are group instru- 
ments; they represent the structured test 
approach to adjustment testing; and they 
all yield a single score indicating level 
of adjustment. 


In developing a rationale for an investigation 
such as this, several points must be considered. 
First, those persons who work with children have 
no feelings of doubt concerning the need for 
further evaluation of adjustment tests. A num- 
ber of writers in Buros’ several editions on tests 
and mental measurements make this point di- 
rectly and by implication. In 1940, for instance, 
Louttit, in writing about the Rogers test, then 
10 years old, described it “ . with the excep- 
tion of the time consuming method of scoring, 
have found it the most satisfactory instrument 
of personality measurement” (30, p. 94). Yet he 
cited only two references, including Rogers’ 
original monograph, wherein the adequacy of the 
test was studied. More recently, Ellis’ two re 
views (15, 16) hardly mention a reference to 
this test's validity. Practically every author who 
discusses the California Test of Personality com- 
pliments the test authors on item writing, relia- 
bility of full test, adaptation for machine scoring, 
and other such points, but they consistently point 
up the lack of validity data for both the test 
as a whole and the individual items. Shaffer for 
example maintains, “It must be concluded that 
the validity of these questionnaires is entirely 
unestablished” (44, p. 56). Similar comments 
could easily be quoted concerning the Rosen- 
zweig P-F Study. 

Complementing this point of view, Kearny 
(27) demonstrates the important need felt by 
teachers. His opinionnaire study indicated that 
elementary school teachers in St. Paul are most 
eager for extended help in the area of guidance 
services. Integral to this are more adequate meas- 
ures of social and emotional growth and develop- 
ment, 

A third aspect of this rationale involves the 
considerable definitional confusion which exists 
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in the variable being measured by these tests 
The test titles and manual discussion refer 
to personality, personality adjustment, mental 
health, and group conformity, as well as a variety 
of other traits and symptoms. The present writer 
considers two concepts as crucial: adjustment 
and mental health. The definition of adjust 
ment used in this investigation is the satisfac 
toriness of the relationship between the indi- 
vidual, a sixth-grade boy, and the environment, 
the sixth-grade elementary class. It is assumed 
that a continuum of poor to good adjustment 
exists and that each boy can be placed on this 
continuum, It is also assumed that the position 
on this continuum is reflected within the indi- 
vidual in terms of a “state” which ramifies into 
the individual's verbal behavior and is capable 
of being measured. “State,” in this sense, refers 
to the individual's mental health or attitudes to- 
ward himself and others. 

Operationally the variable which is assessed 
within the individual depends on the selection 
of the criterion groups. Teachers were asked to 
nominate boys who were “well adjusted” and 
boys who were “poorly adjusted” (see the defin 
ing paragraphs in the Appendix). Children in the 
sixth-grade classes were asked to nominate chil 
dren they liked best and children with whom 
they did not get along. These operations indicate 
the meaning of “satisfactoriness of relationships” 
discussed above. The attitude structure of the 
boys chosen at each level becomes the definition 
of mental health continuum. The implication of 
these definitions as they relate to Havighurst's 
(21) use of the concept of developmental task, 
Symonds’ (49) use of ego strength and Acker 
son’s (1) analysis of behavior problem types is 
given in Smith (45). 

Another pertinent consideration involves the 
criterion. When, as in the present analysis, the 
criterion in an investigation utilizing predictive 
or concurrent validity is an intermediary one, it 
is necessary to indicate the further correlates 
of the criterion. By reviewing the large litera- 
ture on sociometric choice one finds substantial 
support that children highly chosen as friends 
possess characteristics and behavior usually de 
scribed as mentally healthy and well adjusted, 
and that children who are not chosen positively 
and who are rejected possess characteristics and 
behavior indicating maladjustment and mental 
ill health. Smith (45) has organized this litera- 
ture into opinions (18, 19, 40, 56), pupil ratings 
(7, 8, 28, 32), adult ratings (9, 17, 25, 37), camp 
leader ratings (23, 35, 36), and psychiatric re- 
ferrals (50). If a large part of the variance in 
sociometric acceptance can be assigned to per 
sonality and adjustment variables, and if the 
other major variables can be experimentally con 
trolled or partialled out statistically, it is cor 
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cluded that sociometric status is an acceptable 
criterion, or portion of a criterion, in the estab- 
lishment of groups of poorly adjusted and highly 
adjusted children. 

rhis investigation involves a second judgment, 
teacher nominations of pupils, as part of the 
criterion. Such a criterion technique in locating 
maladjustment in children contains many haz- 
ards, Wickman’s study (55) and its replications 
and the many studies it influenced with their 
usual interpretations raise considerable doubt 
that classroom teachers and mental hygienists 
have any agreement as to the nature of malad- 
justment in pupils (26, 29, 34, 47, 48, 51). How- 
ever, the present writer (45), after carefully 
reviewing this literature and relying heavily upon 
an early (and much neglected) but important 
article by Goodwin Watson (54), feels that many 
of these doubts are unjustified. The nature of 
directions given to teachers, differences in mean- 
ing of terms for different groups, lack of ap 
preciation of chronicity of symptoms, and the 
ambiguity of the relation of the symptom to 
the total behavioral context contain the essence 
of this analysis 

When teachers select “behavior-problem” cases 
there is a strong tendency to nominate routine- 
disturbing, overtly hostile, and aggressive chil- 
dren. These children are below average in 
achievement, ability, and socioeconomic status. 
Shifting directions from problem cases to malad- 
justed children elicits a different kind of child 
i.e., a wider variety of regressive and atypical 
personality problems (10, 12, 14,31, 39, 46, 57) 

To use teacher nominations of maladjusted 
pupils care must be taken to stress in the in- 
structions long-range difficulty in adjustment, dif- 
ficulties inherent in the child, and problems re 
lated to getting along with peers, rather than 
the child who is difficult to handle in class rou 
tines. With such instructions one avoids many 
of the differences in terminology connotations 
and the rating of symptoms detached from the 
individual. The child is seen as the unit and 
one evaluates his personal-social effectiveness in 
his environment 


The actual selection of tests to be 
analyzed in this project was made in the 
light of several criteria: (a) the tests must 
be amenable to group administration; 
(b) they must have some evidence of va- 
lidity, past or potential; (c) they must be 
widely used; (d) in combination they 
must represent a variety of item types. 
The reasoning behind such requirements 
or standards requires some explication. 
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VALIDITY OF 
One of the original goals of this inves- 
tigation is the measurement of adjust- 
ment in a classroom situation wherein 
screening rather than case-study analysis 
is important. Group administration is ex- 
tremely important in this regard. That 
such a requirement constitutes a decided 
limitation is not denied. The mention of 
such instruments as the Bender Gestalt 
Test, the Thematic Apperception Test, 
and the Rorschach clearly indicates this. 
Criteria b and ¢ actually were held in 
combination. Few personality and ad- 
justment tests for children present much 
data evidencing strong validity. Some 
tests are currently being used widely with 
little regard for their underlying ade- 
quacy or validity. And finally, in the 
event of negative findings, criterion d 
might lend hypotheses for future re- 
search. 


METHODOLOGY OF THE STUDY 


An investigation analyzing the ade- 
quacy of six adjustment tests for children 
poses several methodological problems: 
(a) specification and analysis of the popu- 
lation from which the sample is drawn; 
(b) description of methods and_ proce 
dures used in obtaining criterion groups 
at the different adjustment levels; (c) 
description of the sample in terms of 
age, parental occupational level, intelli- 
gence, and reading achievement; and (d) 
independent estimates of the validity of 
the criterion groups. 


Population Sampled 


All the children used in this study came from 
the public schools of St. Paul, Minnesota. Con 
sequently, certain limitations occur in the gen 
eralizability of the findings: (a) the subjects live 
in an urban community; (0 
attend public schools: although approximately 
yo"), of the children of elementary age 
do not; (c) the public schools maintain classes 
for children with gross physical disability, both 
sensory and motor, and 


all of the subjects 


SC hool 


mental 


retardation; 
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d) other handicaps, such as reading disability 
and emotional disturbance, plus special abilities, 


such as those of gifted pupils, are handled in the 
regular classroom.? 


rhe criterion used in the selection of par- 
ticipating schools from the total available was 
that the sixth grades must not contain fifth- or 
seventh-grade pupils and the classes must be 
self-contained, i.e., one teacher for all subjects. 
This leaves 29 schools, from a total of 66, con- 
taining $7 sixth-grade classes eligible for the in- 
vestigation; the study includes all 37 classes. The 
37 classes contain 653 boys. Several benefits ac- 
crue to the investigation when all the pupils 
have the same teacher for the whole day and all 
are in the sixth grade. The teachers know the 
pupils in several phases of the academic work 
and also have a chance to observe the pupils at 
the start and close of the day, during recess, and 
in a number of nonacademic situations, Similarly, 
the pupils have a wider variety of contacts among 
their peers. By restricting to one grade level, 
the learning situation has one less major schism. 


Procedures in Selecting Pupils 


One criterion for the selection of the subjects 
consists of teacher nominations, Each of the 37 
teachers received a typewritten form’ devised by 
the present investigator on which to make nomi 
nations of high and low adjustment status. The 
form contains descriptive paragraphs indicating 
the meaning of “very good adjustment” and 
“very poor adjustment” and space for writing in 
names of pupils who fit these descriptions. It 
also contains a third part for the names of 
pupils the teachers do not know well enough 
to nominate. Statements respecting anonymity 
of teachers and pupils and confidentiality of 
records are included in hopes of further validity. 

The descriptive paragraphs indicating adjust- 
ment level reflect several considerations. A bal- 
ance is struck between fairly referents 
tionally dis 
referents such as 
cries easily.” 
a wide range of 
toleration for robust and spirited activity on the 
part of the adjusted group. Similarly efforts are 
made for difficulties than the 
disturber, i.¢., shy 


general 
such as and “emi 
turbed” 


“doesn't 


‘well adjusted 
fairly 
tempe! 
made 


and specific 


lose 


easily” and 


Efforts are to allow for 


other classroom 
and unhappy 
child” to fall in the maladjusted group. Finally, 
the description attempts to place the child's de 
velopment on the long-range perspective of the 
significance for future adjustment 

The nominations by the 
variability. 


“excessively 


teachers show some 
First, the nominations for the “can 
* Administrative Offices, St. Paul Public Schools. 
Personal communication, 1955 


This form is reproduced in the Appendix. 
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not say” category represent a problem, the degree 
to which teachers felt unsure about a pupil's 
adjustment status. Thirty-eight per cent of the 
teachers nominated two children and 24% 
nominated one child. Frequently the teachers 
used this with new pupils, but often with those 
with whom the teacher was not well enough 
acquainted to make a judgment. Logically such 
a procedure should eliminate a considerable 
number of cases of inadequate knowledge of 
pupils. 

The teacher nominations contain a second type 
of variability. Ninety-two per cent nominated 
four or five very well adjusted boys, but only 
68°, nominated four or five very poorly adjusted 
boys in the class. Such percentages indicate 
clearly that the teachers recognized and/or were 
more willing to classify children at the high end 
of the adiustment continuum. 

Sociometric nominations resolve into positive 
and negative choices, both of which were used. 
This choosing was accomplished by using another 
instruction form‘' devised by the investigator 
which was read to each class. First, the children 
designated “the classmates they liked best and 
got along with best.” These names were placed 
on the top of the page. Second, on the bottom 
half of the paper, the pupils nominated or 
designated “the children with whom they and 
their classmates didn’t get along.” Although the 
children could nominate as many as they wished, 
it was suggested that they select four or five for 
each category. Even though the study involves 
only boys, it was decided that the entire class cli- 
mate, both girls and boys, should be assessed 
and utilized in the selection of the criterion 
groups. 

\ tabulation of these positive and negative 
nominations was made. There is a high degree 
of variability in the number of nominations re- 
ceived by individual boys. The range is from o to 
25 positive nominations and o to —26 negative 
nominations. The two lists were made into one 
ranking by counting all favorable nominations 
received +1 and all unfavorable nominations 
received —1. This gives a peer acceptance hier- 
archy. For example, one of the boys may have 
been nominated by each of twenty peers as one 
of several best friends. Three other classmates 
may have listed him as a classmate with whom 
they did not get along. Seven others might not 
have nominated him for either category. Con 
sequently his score would be +17. Another boy 
may have been listed by four classmates as one 
of their best friends but listed by twelve others 
as one with whom they did not get along well 
and not nominated by fourteen. His score on the 
combined ranking would be —8. 


This form is reproduced in the Appendix 
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There are several aspects of the sociometric 
peer nominations that should be noted. First, 
a wide variability from class to class occurs in 
the ratios of frequency of positive nomination 
to frequency of negative nomination. Table 1 
presents these results. Here it is seen that the 
classes varied markedly in being positively and 
negatively oriented in nominations of boys. The 
trend to nominate more boys as good friends 
and well liked than to nominate them as boys 
with whom one does not get along is very clear. 
In only one class are there more negative than 
positive nominations. This predominance of posi- 
tive feeling is also found to exist in the teacher 
nominations of pupils. 


TABLE 


DISTRIBUTION BY SCHOOL CLASSES OF .THE 
RATIOS OF POSITIVE TO NEGATIVE 
RECEIVED BY ALL 
Boys IN POPULATION 


Ratios of positive 
to negative choices N % 


© 
received 
2.30 3 8 
2.10-2.29 5 13 
1.Q9o-2.09 7 19 
1.7O-1 .87 3 8 
1.50-1.09 7 19 
1.30-1.49 5 13 
1.00-1.29 
- I 
37 99 


When analyzed by individuals within a class, 
it is seen that the negative nominations, as well 
as the positive nominations, tend to cluster 
around a small number of pupils. The mental 
health effects of this both as cause and effect in 
maladjustment present an interesting problem be 
yond the scope of this discussion. For illustrative 
purposes a tabulated class record of peer choices 
is included in Table 2. This specific record con- 
tains a bias in being exceptionally clear-cut in 
differentiating the high and low acceptance of 
individual boys. Pupils B, D, and K, for instance, 
are operating in an entirely different social and 
emotional climate than are pupils A, I, and Q 

For all of the boys who ultimately became 
part of the 297 in the initial adjustment groups, 
using the combined teacher and pupil nomina- 
tion techniques, the range in sociometric nomina 
tions is of interest. These data are presented in 
Table 3. Only a slight overlapping of the dis 
tributions occurs. Considering the range of posi 
tive to negative class nomination ratios, such 
clear sociometric differences in total distributions 
as presented in this table give an important in- 
dication of the method's success. 
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TABLE 2 


ILLUSTRATIVE CLASS RECORD OF 
SOCIOMETRIC NOMINATIONS 


osi- Nega- 
Pupi tive tive - Rank in 
upil nomi- nomi- class 
nations nations 

A 14 —10 16 
B 25 ° 25 I 
Cc 6 2 4 7 
D 21 ° 21 2 
E 4 2 2 10.5 
F 2 Ss 6 15 
G 2 4 — 2 13 
H S 2 6 6 
I 4 15 —11 17 
J 5 2 3 8.5 
K 17 ° 17 3 
a 3 ° 3 8.5 
M 3 4 — 1 12 
N 4 2 2 10.5 
11 ° 4 
r I 6 — § 14 
Q I 16 —15 18 
R 11 2 9 5 


The Combination Criterion 


+ The literature indicates that there are other 
than adjustment correlates of each of the cri- 
terion techniques, therefore a combination of 
criteria should prove more advantageous than 
either used separately. Consequently the follow- 
ing procedures were followed. The teacher ratings 
already were conveniently in three categories— 
those nominated as well adjusted, those nomi- 
nated as poorly adjusted, and a middle group 
of unnominated persons. No mention of the last 
group was made to the teacher; however, on a 
logical basis, those who remain after the top and 
the bottom extremes and the unknowns are elimi- 
nated would be in the average adjusted range. 
The composite accepted and rejected peer nomi 


TABLE 3 
COMPARISON OF DISTRIBUTIONS OF THI 
COMBINED PEER NOMINATIONS 
RECEIVED FOR THREE ORIGINAI 
ADJUSTMENT GROUPS 


Adjustment groups 


Poorly \verage Well 
adjusted adjusted adjusted 


Statistic 


2 7 25 
Os 5 I! 
Mdn — § 2 9 
—; 10 I 7 
R —25 1 3 


PERSONALITY 


TESTS 


nation 
thirds. 


hierarchy was broken arbitrarily into 

Ihe subjects selected then met these require- 
ments: for the well adjusted group the pupil 
must be in the top third on sociometrics and 
on the teacher's list as very well adjusted. For 
the maladjusted group the pupil must be in the 
bottom third of the sociometrics and must be 
listed as maladjusted by the teacher. The aver- 
age adjusted must be in the middle third of the 
sociometric rank and not be listed either high 
or low by the teacher. Those who did not meet 
two criteria were considered doubtful as 
to adjustment status and were eliminated from 
the study 


these 


To clarify the procedure a previous example 
is continued. The boy with a +17 score, for 
instance, is in the top third of the sociometric 
hierarchy. If his teacher has also selected him 
as well adjusted, then he falls in the well ad- 
justed group. Another boy selected by the teacher 
as well as adjusted but falling in the middle group 
on the sociometrics would not be selected be- 
cause of not meeting the dual standard. A simi- 
lar procedure was used in the average adjusted 
and in the maladjusted groups. In general the 
teacher nominations agreed with the pupil 
nominations; however, there were some serious 
differences where a pupil was found to be well 
liked but not considered adjusted by the teacher. 
The reverse also occurred. A three-by-three con- 
tingency table with nine cells was constructed 
to determine the relationship between the two 
selection techniques. The contingency coefficient 
was .47. 

The initial criterion groups chosen by these 
techniques require comment. This writer be 
lieves the techniques are not adequate for giving 
information about every child in the class. For 
instance there is the child who has been nomi 
nated in the well liked category by the children 
and placed by the teacher in the poorly adjusted 
category. For the present purposes he remains 
an enigma. He becomes one of the cases that 
lowers the correlation of each technique with 
the hypothetically pure rater of adjustment. He 
is not understood with the data at hand, and for 
this reason he is omitted from the present study. 
However, the fact that some pupils cannot be 
classified should in no detract from the 
validity of the classification of those about whom 
both criteria agree. 


way 


Because all the tests studied are of the paper- 
and-pencil variety and require a minimum of 
fourth-grade reading skill, it was imperative that 
a final selection be made on reading achievement 
before identifying the final three groups at dif- 
ferent adjustment levels). The Gates Advanced 
Primary Reading Test, Part Two, Paragraph 
Reading, was selected for this purpose, Although 
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COMPARISON OF THE THREE ADJUSTMENT GROUPS IN TERMS OF DIFFERENTIAL 


Variable 


Pupils initially selected by dual criteria 
Pupils eliminated due to absences and moving 


Pupils eliminated due to reading achievement below 4.0 


Pupils finally tested 
Total number of boys in the 37 classes 


designed for lower grades, it discriminates quite 
adequately between grades 3.5 and 4.5. The class 
room teachers gave this test to the pupils in the 
initial adjustment groups when the grade status 
was approximately 6.4. All of those pupils who 
scored 4.0 and above were scheduled for final 
testing with the six personality and adjustment 
tests, 

A few additional pupils were lost due to mov- 
ing and absences during the process of carrying 
out the investigation. The specific number of 
individuals lost is in Table 4. 

In summary, the actual procedures used in the 
selection of the pupils were executed fairly 
simply. The teachers nominated up to five chil 
dren as very well adjusted and very poorly ad 
justed. The pupils nominated classmates they 
liked as best friends and classmates with whom 
they did not get along. The two lists of nomina 
tions were combined to select children at three 
levels of adjustment. A reading test was ad 
ministered to eliminate children from the cri- 
terion groups who were below fourth grade in 
reading achievement, A few children were lost 
from the criterion groups due to illness and 
changes in residence. The remaining children be 
came the sample of pupils tested. These are the 
children on whom the results of the study are 
based and about whom the conclusions are 
drawn. 


Test Administration Procedures 


The actual administration of the six tests of 
personality adjustment occurred as follows. The 
tests were given in a random order except for 
the final few schools. Here a minimum rearrange 
ment was carried out to force the tests into a 
pattern of no test ever being administered more 
than six times as the first test of the group, the 
second, or the third, and so forth. In this way no 
test had any benefits or handicaps over the others 
accruing from being administered at the begin- 
ning, middle, or end of the testing session. A 
short “break” was taken after the first hour to 
hour and a half 
The examiner read a large part of the tests 


REDUCTION IN SAMPLI 


SIZE 


Adjustment groups 


Poorly \verage Well 
Total 
adjusted adjusted adjusted 

92 990 100 297 

f 2 4 12 

23 15 2 40 

63 2 100 245 
653 


even though the pupils had their own booklets 
The suggestion for this procedure arose from the 
first group tested. The subjects, almost unani 
mously, favored such reading. This step speeded 
the test administration time considerably and 
decreased the work and potential fatigue of the 
pupils. It minimized the individual differences 
in working pace. In general the groups stayed 
pretty well together; however, the more able 
pupils often went ahead at their own rate on 
each test 

Since all subjects started each test at the same 
time, any pupils finishing early were permitted 
to draw on the back of the booklets while wait- 
ing for the others to finish. The children took 
wide advantage of this opportunity on the backs 
of the Rosenzweig P-F Study and the How 
Would You Finish It? test, for these were usually 
not read by the examiner. Incidentally the draw 
ing on the booklets interested the children, oc- 
cupied their free time, and added a considerable 
degree of control to the situation. 

Although the effects of such concentrated test- 
ing are not determined, the following observa- 
tions are noted. In general, the pupils were quite 
eager to be out of class for most of the morning. 
Most of them enjoyed the variety in the testing, 
and only when the California Test of Personality 
and the How I Feel About Things came in se 
quence did they become restive. Most of the chil 
dren took the tests seriously although they would 
laugh or make humorous comments at. indi 
vidual items. Some of the pupils were quite 
flippant and difficult to control for the period 
The break in the middle of the testing period 
proved relaxing. The most unhappy aspect o¢ 
curred if a recess period was missed, At the close 
of the testing most of the pupils were about 
ready to go back to class; however, as they left 
they invariably would comment that if any more 
tests were to be taken they would like to be 
chosen 


Sam ple 


With a description relative to the techniques 
for obtaining the subjects at the three adjust 
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TABLE 5 


COMPARISON OF FINAL THREE ADJUSTMENT 
Groups ON Four DESCRIPTIVE 
VARIABLES 


Adjustment groups 


Variable Poorly Average Well 
adjusted adjusted adjusted 
N =63 N =82 N =1 
Age 
Mean 11.68 11. 11.6 
SD 55 $5 
Intelligence 
Mean 97.13 102.61 107.91 
SD 10.09 10.35 10.34 
Reading Achievement 
Mean 5.61 6.10 6.48 
SD 1.05 1.09 
Parental Occupational 
AVE 
Mean 2.48 34 I 
SD 71 


ment levels in mind, further elaboration is re 
quired to better understand the sample studied 
Ihe variables considered are age, intelligence, 
reading achievement, and parental occupational 
level. 

The age of the subjects as of December 31, 
1954, is used for a constant reference. Since all 
the pupils were ‘ested within a period of two 
months such a procedure seems feasible. The 
average age for each adjustment group is slightly 
over 1114. The simple technique of subtracting 
five gives the grade status in which the pupils 
should be. This is halfway through the sixth 
grade. The standard deviations, although sig- 
nificantly different for the three groups, range 
from about one-third to one-half year and in- 
dicate, for practical purposes, that the groups 
are homogeneous. This reflects a strong age-grade 


ANALYSIS OF 


Variable Source ‘of variation 


Age Between groups 
Within groups 
Total 


Intelligence Between groups 
Within groups 


Potal 


Reading Achievement Between groups 
Within groups 
Parental Occupational Level Between groups 
Within groups 
Potal 


tions are recorded in the Appendix 


TABLE 6 


VARIANCE OF THE FINAL 


THREE ADJUSTMENT GROUPS ON Four 
DESCRIPTIVE 


* The tests of homogeneity of variances to determine the tenability 


promotion 
Schools 


policy within the St. Paul Public 


Intelligence test scores on the Otis Quick 
Scoring Test of Mental Ability (38) from the city- 
wide testing program were available for most 
of the pupils. Some of the pupils had been given 
the individual Stanford-Binet and Wechsler In- 
telligence Test for Children. If the group tests 
were not available, these were used. Some half 
dozen pupils with neither record available were 
given the Ammons Picture Vocabulary Test (3) 
as a rapid screening measure of intelligence. As 
indicated in Tables 5 and 6, the groups are sig 
nificantly different in intelligence 

The results from the Gates Advanced Pri 
mary, Paragraph Reading Test (20) originally 
used in screening the pupils also were used as a 
general reading achievement measure. Because of 
the limited ceiling on this test, any differences 
occurring probably would be a minimal reflection 
of differences in actual ability. Despite the dif- 
ferential climination of a number of poor readers 
and the lack of ceiling on the test, the adjustment 
groups are very significantly different in reading 
achievement. Pupils nominated by their teachers 
as very well adjusted and nominated by their 
peers as best friend are achieving pupils as com- 
pared to pupils comprising the average and 
poorly adjusted groups 

The Minnesota Scale for Parental Occupa- 
tions (53) was used to classify the level of pat 
ental occupation. School records supplemented 
by teacher and pupil information were the 
sources of the data. To obtain categories with 
large enough numbers to handle, the seven 
groupings were combined into three. Classes I 
and II became Group One, Classes IIIT and 1V 
became Group Two, and Classes V, VI, and VII 


VARIABLES 


if Mean 
square 
2 27 1.40 Os 
242 i8 
24 


of the technique’s assump 


2 2281.99 21.58 <.01 
242 105.75 
| 244 
j 2 20.68 17.46 
242 1.18 
244 
2 2.64 4.42 < Oos>.o!l 2 
242 60 
| 244 


became Group Three. Group differences in level 
of parental occupation show a positive relation 
between socioeconomic status and good adjust- 
ment. Such findings are consistent with the 
intelligence and ‘achievement differences. 

In summary there were significant differences 
for consistently higher mean scores moving from 
poor to good adjustment on intelligence, read- 
ing achievement, and level of parental occupa- 
tion. No differences existed in mean ages of 
the groups. Table 4, presented earlier, gives 
the results of selection techniques in terms of 
sample size findings. 


Independent Estimate of Criterion 
Validity 

Earlier, an assumption was stated that three 
levels of general adjustment could be established 
through a combined technique of teacher and 
pupil nominations. Reference to literature sup- 
porting this contention has already been made. 
Four independent estimates of the validity of 
this assumption clarify this point. One of these, 
pupils who are currently serving on the school 
police patrol, is an estimate of relative honor 
and responsibility, an attribute of adjustment. 
Referrals to the school social workers, referrals 
to the community child guidance clinic, and 
arrests and records at Juvenile Police all indi- 
cate children with problems and difficulties of 
adjustment. Although complete independence 
of each validity estimate is desirable, this goal 
has not been reached. Principals and teachers 
select pupils for the school police and make 
referrals to the school social workers. Referrals 
to the community guidance clinic originate from 
parents and community agencies including the 
school social workers and the juvenile court. 
Arrests and records at the juvenile division are 
strictly a police matter, 

These independent data estimate the ade- 
quacy of the combination criterion, pupil and 
teacher nominations; consequently, the initial 
adjustment groups totaling 297 pupils comprise 
the sample discussed rather than the final tested 
sample of 245 subjects. This larger group also is 
advantageous because the frequency of some of 
the behaviors is small. 

Table 7 presents the data relative to mem 
bership on the school police patrol’ In this 
case the numbers in the totals are less than in 
the criterion groups because only 17 of the 29 
schools have school patrols in which sixth-grade 
pupils are allowed to participate. A clear rela 
tionship occurs between level of adjustment and 
being on the force. The extreme categories of 


* Office of the School Police, Department of 
Public Safety, St. Paul, Minnesota. Personal com- 
munication, 1955. 


8 LOUIS M. 


SMITH 


TABLE 7 
COMPARISON OF CURRENT PARTICIPATION ON 
PoLice Force BY PuPILs IN 

THE THREE ADJUSTMENT 


Adjustment groups 


Level of Poorly Average Well 
participation adjusted adjusted adjusted 
N % N % N % 
Patrol officers ° ° ° ° au 32 
Patrol members 23 42 44 7° 36 56 
Not on patrol 32 58 19 30 8 12 
Total $5 100 63 100 65 . 100 


the table indicate this most clearly. Thirty-two 
per cent of the well adjusted group are officers 
on the force, while none of the average or 
poorly adjusted group are officers. Fifty-eight per 
cent of the poorly adjusted group did not make 
the force as compared to 12°(, of the well ad- 
justed group. Two further comments are in 
order. A number of the members of the poorly 
adjusted group who are school police came from 
just a few schools, where practically the whole 
class is on the force. Second, a school police 
position is occasionally used by these principals 
and teachers as a motivational technique or per- 
haps as an “evidence .of faith’ to bolster the 
self-esteem and to aid in the social integration 
of pupils with adjustment difficulties. 

The visiting teacher or school social worker is 
a part of the special services program available 
to the school personnel. Her job function lies 
primarily in problems of emotional disturbance, 
social maladjustment, and truancy. In general, 
the casework technique of interviewing children 
and parents, consulting with teachers and other 
school personnel, and. making referrals to com- 
munity agencies constitute their approach to the 
problem of maladjustment. 

With such functions and procedures in mind, 
the data in Table 8 are presented (see footnote 


rABLE 8 


COMPARISON OF REFERRALS OF CHILDREN IN 
THREE ADJUSTMENT GROUPS TO THE 
ScHooL Social WORKER 


Number in adjustment groups* 


lime of referral 


Well 


Poorly Average 
adjusted adjusted adjusted 
September 1954 
March 1955 15 3 ° 
January 1953 
June 1954 23 2 I 
Total 38 5 I 


* These figures do not indicate number of differ- 
ent individuals, for a few of the children were 
referred both vears. 


| 
4 
| 
4 


VALIDITY 


OF 


2 preceding). During the current school year 
18 children in the criterion groups were re- 
ferred to the visiting teacher. Such referral is 
usually initiated by the teacher to the principal 
and then to the visiting teacher. This in and of 
itself would not give adequate support to the 
contention of adequacy of the criterion groups, 
for the teachers, as was described, contributed 
to the selection of the latter groups. How 
ever, the referrals for the vear and a half 
preceding the present study indicated that there 
were other teachers who considered the children 
or the situation, as needing outside help. And 
incidentally such data over a period of time 
show that for a number of the children de 
scribed as poorly adjusted the problems are not 
transient but of a long-standing nature  Al- 
though not reported, data from earlier years 
indicate several were noted even then. There 
were also a number whose status has changed. 

Twenty-five boys in the 37 classrooms were the 
total referrals to the visiting teachers during the 
present year. Of the seven not included in the 
study three were in the teachers’ median ad 
justed group for they were not nominated by 
the teacher as very well or very poorly adjusted 
—but all three were in the bottom third on the 
sociometric peer nominations, Four children 
were nominated by the teacher as poorly ad 
justed. Of these there were two in the middle 
sociometric group. They bordered on the lower 
end of this group. The other two presented a 
serious discrepancy for on the peer nominations 
they were in the top third. Consequently, of the 
25 referrals only two are seriously ambiguous in 
terms of the present analysis. 

The community of St. Paul has a privately 
endowed child guidance clinic specializing in 
treatment of children with problems of adjust- 
ment. Table g presents the data concerning re- 
ferrals and treatment at this clinic. Of the 
current cases all but one are in the poorly ad 
justed group. Although the absolute numbers 
are not large, the relative differences in propor- 
tions of recently referred cases and cases in treat 
ment is of interest. For the latter, 6 cases in 92 
is only a percentage of 6.52; however, when one 
combines the average and well adjusted groups 
of children, only 1 case in 205 occurs, This is 
0.487 per cent. The ratio is over 13 to 1 in favor 
of more referrals in the lower group. 

The City of St. Paul, like many other urban 
communities, has a juvenile division within the 
police department.’ All arrests of persons 18 
vears of age and vounger are channeled through 

* Thorsen, D. Personal communication, 1955. 

* Roberts, J. Juvenile Division, St. Paul Police 
Department, Bureau of Public Safety. Personal 
communication, 1955. 


PERSONALITY 


TESTS 


TABLE 9 


CHILDREN IN THE CRITERION Groups WHO 
HAVE BEEN REFERRED AND TREATED 
aT GUIDANCE 
CLINIC 


Number in adjustment groups 
Type of contact 


Poorly Average Well 
adjusted adjusted adjusted 
Current cases, January 1055 6 1 ° 
Recent referrals January 
1953-January 1055 in 
cluding current cases 7 ? ° 


Treatment cases closed® 
Reterred but withdrawn 


® Most of these case contacts occurred prior to 1953 


the juvenile division. Most children who are 
arrested come in with their parents for a con- 
ference. Usually the child is warned, restitution 
is made if there is property damage, and no 
further action is taken; however, some of the 
cases are taken to court and probation or com- 
mitment occurs 

The crimes for which children in the criterion 
groups were booked included such incidents as 
shoplifting a 10-cent item from a 5-and-10-cent 
variety store, property damage from several dol 
lars to over a thousand dollars, automobile 
theft, arson, window peeping, running away 
from home, and sodomy. There were another 
half dozen categories of delinquencies so that 
practically the entire range of legal difficulties 
a child under 12 years of age could commit are 
included. That some of the crimes are insig- 
nificant from an adjustment point of view is not 
denied; however, one would expect a relatively 
lower frequency of arrests in the well adjusted 
and average adjusted groups as compared to 
the poorly adjusted group 

Almost 22°; of the children in the poorly 
adjusted criterion group have been arrested at 
least once in the last two years. This is con 
trasted with 5°%, to 6% of the median and well 
adjusted groups. Arrests prior to this time also 
show a relationship between arrest frequency 
and difficulty in adjustment. For the arrested 
children the modal number is only one time 
arrested, but the chronicity of legal difficulties 
lies heavily within the poor adjustment group. 

Although not tabled, a final set of facts is 
appropriate. This concerns the disposition of 
the cases. As mentioned earlier, parent confer- 
ences, restitutions, and warnings are the usual 
procedures. Only five individuals committed 
crimes serious enough by police standards & 
warrant referral to juvenile court for review by 
a judge. All five of the children are in the poor 
adjustment group. All five were placed on pro 
bation. Three children, again all in the poor 
adjustment group, were referred for psychiatric 


a 
i ; 4 
44 
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TABLE 


COMPARATIVE PERCENTAGES OF ARRESTED 
CHILDREN IN THE THREE CRITERION 
Groups ACCORDING TO DATES OF 
Most Recent ARREST 


190 


Adjustment groups* 


Poorly Average Well 
adjusted adjusted adjusted 
N % in N % in N % in 
Group Group Group 


January 1953 
March ross 20 32.7 5 §.05 
Prior to Decem 
ber 1952 4 4.04 1.890 
Total 2 28.2 9 9.090 ; 7-55 


5.66 


®*N in adjustment groups is as follows: poorly adjusted 
92; average adjusted, 90; well adjusted, 106. 


diagnosis and treatment. Two are included in 
the statistics related to the Child Guidance Clinic 
and one received private psychiatric care. The 
precipitating incident in one case was running 
away from home and in the other it was sodomy. 

In summary, the independent validity data 
consistently support the rationale of the selec 
tion of the criterion groups. There was a direct 
relationship between being on the school police 
force and adjustment level. All the police offi- 
cers were from the well adjusted group. De- 
cidedly more children in the poorly adjusted 
group were referred the visiting teachers 
both this year and last; more have been arrested 
at least once and more have been arrested more 
than once; finally more were under psychiatric 
care in the community guidance clinic, 


to 


RESULTS OF THE INVESTIGATION 
The analysis of the findings follows, in 


general, a simple organization. Des« rip- 


TABLE 11 


COMPARISON OF TOTAL NUMBER OF ARRESTS 
OF CHILDREN IN THE THREE CRITERION 
Groups 


Adjustment groups 
Frequency of 
arrests 


Well 


adjusted 


Average 
adjusted 


Poorly 
adjusted 


& 


° 


Tota! N of 
arrests 


M. 


SMITH 


tive statistics for each test are presented. 
The results of each test are analyzed by 
analysis of variance indicating statistical 
significance of mean differences, by analy- 
sis of covariance indicating mean differ- 
ences when intelligence, parental occupa- 
tion, and reading achievement are con- 
trolled and by percentage of overlap in- 
dicating amount of overlap of distribu- 
tions. A brief analysis of the relationships 
among the tests is also included. 


California Test of Personality 


The California Test of Personality 
contains two subtests, Personal Adjust- 
ment (PA) and Social Adjustment (SA). 
Results of the two subtests sum to give 
a single score indicating an individual's 
total adjustment status or level. Tables 
1g and 13 contain the descriptive statis- 
tics—sample size, mean, and standard de- 
viation and the analysis of variance re- 
sults. The F tests in Table 13 are highly 
significant; the null hypotheses are re- 
jected. In short, it can be concluded that 
this test does differentiate statistically be- 
tween levels of adjustment for sixth- 
grade school children. Theoretically this 


rABLE 


STATISTICS FROM THE CALIFORNIA 
Test OF PERSONALITY 


12 


DESCRIPTIVI 


Adjustment groups 


\spect of 


Well 
the test 


adjusted 
/=100 


Average 
adjusted 


N=82 


Poorly 
adjusted 


= (3 


Total score 
Mean 
SD 
Personal 
adjustment 
Mean 
SD 
Sox ial 
adjustment 
Mean 
SD 


.96 


4 th 
10 
= 
: 
= 
° 18.72 160.389 16.26 
° 
° 
° 47-70 53-37 §5-95 
° 10.7! Q.27 9.27 
4 
: 48.50 53-57 50.01 
48 13 8 9.506 Q.24 8.10 


VALIDITY OF 


ANALYSIS OF VARIANCE OF 


Aspect of the test Source of variation 
Total score Between groups 
Within groups 
Potal 


Personal adjustment Between groups 
Within groups 


lotal 


Social adjustment Between groups 


Within groups 
Total 


is important in that it indicates the 
groups can be differentiated through 
their verbal behavior on a paper-and- 
pencil test. 

The use of the analysis of covariance 
technique basically indicates similar re- 
sults of mean differences; however, when 
pretest differences in intelligence, paren- 
tal occupation, and reading level are 
equated, the F values consistently drop. 
Table 14 presents these findings. 

It is interesting to note also that the 
mean values of the Personal Adjustment 
and Social Adjustment subtests vary less 
than a point within each level of adjust 
ment. In terms of the test author's de- 
scription of the test, there is no difference 
in personal and social adjustment within 
each group, The product-moment corre 


lations between the subtests for each 


Source of variation 


Variable held constant 


Intelligence otal 

Within groups 
Adjusted mean 
Reading achievement Total 

Within groups 
Adjusted mean 
Parental occupational level otal 

Within grou; 
Adjusted mean 


PERSONALITY 


PESTS 


rABLE 13 


THE CALIFORNIA 


OF PERSONALITY 


df Mean square F p 
2 4.737-45 10. 37 < .01 
242 280.44 


idjustment are .75 for the well 
adjusted group, .66 for the average ad- 
justed group and .7o for the poorly ad- 
justed group when not corrected for un 
reliability. Such analysis indicates that 
each subtest measures to a considerable 
degree the same thing. 

Table 15, presenting percentage of 
overlap, gives an indication of the simi- 
larity of the distributions and the prac- 
tical or psychological significance of the 
results. Within each level of adjustment 
the range in raw score values covers the 
complete scale. Such findings are one in 
dication of the tenuousness in establish- 
ing cutoff scores to enhance prediction 
or jadgment-making in regard to the in- 
dividual case. ‘The same conclusion oc- 
curs in reading Table 15 in terms of 


false positives and negatives. For in 


rABLE 14 
ANALYSIS OF COVARIANCE OF CALIFORNIA TEST OF PERSONALITY 


Porat Scort 


df Mean square F p 

243 

288.45 hele) ol 
2828.17 


244 
2 1,304.85 13.04 <.01 
242 03.53 
244 
244 
‘ 
4 
243 
241 292.18 12.04 
2 
243 é: 
241 208.70 12.82 < 
; 2 3305.49 
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TABLE 15 


PERCENTAGES OF ADJUSTMENT GROUP 
EXCEEDING THE MEAN OF THE OTHER 
Groups ON THE TOTAL SCORES OF 
THE CALIFORNIA TEST OF 

PERSONALITY 


Number and percentage above the mean 


Well 
adjusted 
N Q 


Adjustment 
group 


Average 


Poorly 
adjusted 
N &% 


adjusted 
N % 
Poorly adjusted 20 32 
Average 
adjusted 
Well adjusted 


60 
85 


73 


85 74 74 


stance, by using the average score of the 
poorly adjusted group as the cutoff point, 
one can screen 50% of the true positives, 
the maladjusted children, At the same 
time, one screens 27% of the average ad- 
justed group and 15% of the well ad- 
justed group as false positive. To im- 
prove the prediction of true positives one 
includes a growing percentage of false 
positives. 


How Would You Finish It? 


The How Would You Finish It? test 
is a 10-item sentence completion blank. 
It is scored on the affectivity of the re- 
sponse—positive, negative, or neutral— 
made by the subject to the stimulus 
words. The analysis of variance technique 
indicates that the groups differ statisti- 
cally in the appropriate direction. The 
probability of such differences arising by 
chance is greater than .o1 and less than 
.o5. These data are in Table 16. The 
analysis of covariance, in equating intel- 
ligence scores of the groups, raises the 
value of F slightly; however, when initial 
differences in reading achievement and 
parental occupation are eliminated, the 
F value drops below the .o5 level of sig- 
nificance. One concludes that the statis 
tical significance of mean differences be- 
tween groups on this test is ambiguous. 

Phe distributions of the groups on this 


M. 
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TABLE 


DESCRIPTIVE STATISTICS FOR THE How- 
Woutpb- You-Finisu-It Test 


16 


Adjustment groups 


Well 
adjusted 
N=100 


Poorly 
adjusted 


Statistic Average 


adjusted 
N=82 


Mean 
SD 


test show that each group has at least one 
member scoring as low as g and each has 
more than one individual scoring at the 
maximum of go. The mode is 18 in all 
three groups. The distributions are nega- 
tively skewed. A tabular presentation of 
overlap percentages indicates a cutoff 
score obtaining 50% true positives will 
include 49% false positives from the 
average adjusted group and 39% false 
positives from the well adjusted group. 
For all practical purposes the distribu- 
tions are identical. 


How I Feel About Things 


The How I Feel About Things test 
consists of an adjustment subtest and a 
combined adjustment-maturity subtest. 
The sum of these gives the full scale 
score. Both of the subtests and the full 
scale discriminate between the groups 
better than chance. All three F values in- 
dicating mean differences are highly sig- 
nificant, When the covariance technique 
is used to account for the initial differ 
ences in intelligence, reading achieve- 
ment, and parental occupation, the F 
value of 11.33 drops to 4.93, 7.08, and 
7-93 respectively. In short, the group dil- 
ferences would be less if an experimental 
control of these variables had been un- 
dertaken. These results are in Tables 17, 
18 and 19. 

The correlation coefficients of the sub- 


tests within each group are .65, .48 and 
‘ 


12 
N=63 || 
15.05 15.29 16.00 i 
14 22 2.73 2.04 2.3% 
12 49 
: 


VALIDITY OF 


PERSONALITY TESTS 13 


TABLE 17 rABLE 20 
DESCRIPTIVE STATISTICS FROM THE How- PERCENTAGES OF Eacn ADJUSTMENT Group 
I-FeeLt-ABout-THINGs TEST EXCEEDING THE MEAN OF THE OTHER 
— GROUPS ON THE TOTAL SCORES OF 
Adjustments groups Tre 


Aspect of the TEst 


rane Poorly Average Well 
adjusted adjusted adjusted 
yj =63 N =82 N =100 Number and percentage above the mean 
Full scale Adjustment Poorly Average Well 
Mean 27.54 35.32 39.68 group adjusted adjusted adjusted 
SD 16.84 16.11 14.98 N % N % N % 
Adjustment subtest 
Mean 14.51 18.20 20.76 Poorly adjusted 24 38 18 29 
SD 8.08 7.93 7.48 Average 
Adjustment-maturity adjusted 60 73 36 44 
subtest Well adjusted 82 82 7° 70 
Mean 13.03 16.93 18.92 
SD 10.40 10.69 


How I Feel About Things Test. These 
.0 respectively for the well adjusted, findings are noted because of the basic 
average adjusted, and poorly adjusted similarity in kinds of items within the 
groups. The values indicate that the sub- two tests. 
tests are only partially independent of Table 20 indicates the significance of 
each other, In comparison, the subtests the test for individual prediction, Once 
of the California Test of Personality are again the wide range of scores in each 
more similar than the subtests of the adjustment level and extensive overlap 


TABLE 18 
ANALYSIS OF VARIANCE FOR THE 


Aspect of the test Source of variation dj Mean square F p 
Full scale Between groups 2 2840.75 a3 <.01 
Within groups 242 251.45 


Total 


Adjustment Between groups 7 
Within groups 242 60 


Total 2 


Adjustment-maturity 


Between groups 
Within groups 242 103.98 
Total 


TABLE 19 
ANALYSIS OF COVARIANCE OF THE How-I-FEEL-ABpoutT-THINGS TEST 


Variable held constant Source of variation df Mean square F p 
Intelligence Total 243 
Within groups 241 230.91 4.93 <.o1 


Adjusted means 2 


Reading achievement Total 243 
Within groups 241 248.30 7.08 <.o! 
Adjusted means 


Parental occupational level Total 243 
Within groups 241 225.43 7.07 <.o1 
Adjusted means 707 


7 244 
75 


14 


make it impossible to ascertain adjust- 
ment levels for the individual pupil with 
this test. However, the continued finding 
of statistically highly significant differ- 
ences in mean scores is of theoretical im 
portance even though the test as such 
has more limited practical use. 


Things I Like To Do 


This is a test of positive and negative 
attitudes toward many activities in the 
child's environment. It is 
scored in terms of total likes. The means 
and standard deviations are quite simi- 


day-to-day 


lar, The analysis of variance indicates 
there is no mean difference beyond 
chance in the response of the three 
groups to the test. The data are in Table 
21. Application of the analysis of covari- 
ance indicates slightly higher F values; 
however, only in the instance of the cor- 


TABLE 21 


DESCRIPTIVE STATISTICS FOR THE 
Test 


Adjustment groups 


Statistic Poorly Average Well 
adjusted adjusted — adjusted 
N=63 on N=82 N= 100 
Mean 24.30 24.65 25.70 
SD 5-37 5.13 5-15 


rection for intellectual differences does 
the F indicate differences great enough 
to reject the hypothesis of no difference. 
Graphically the distributions overlap al- 
most completely with the lowest score 
actually by a member of the well ad- 
justed group, and the highest scores by 
members of the average and poorly ad- 
justed groups. One must conclude that 
for purposes of selection, individual 
guidance and prediction, and research 
this test is not a valid indicator of ad- 
justment status. 
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FABLE 22 


DESCRIPTIVE STATISTICS FOR THE ROGERS 
Test OF PERSONALITY ADJUSTMENT 


Adjustment groups 


Aspect of the test Poorly Average Well 
adjusted adjusted adjusted 


N =61 N=81 = 99 


SD $.3 4.45 3.41 
Social Maladjustment 
ean I 3 1 12.8 
SD é 
Family Maladjustment 
Mean 8.62 8.26 
SD 3.406 3.61 3.1 
Daydreaming 3.1¢ 2.80 37 
35 14 26 


Rogers Test of Personality Adjustment 


In spite of the precautions taken by the 
investigator, the test re- 
sponded. to inappropriately in four cases; 
consequently, four fewer cases are in the 
total group. Two are lost from the poorly 
adjusted group, and one each from the 
average and well adjusted groups. 


Rogers was 


The analysis of variance technique in 
clicates between 


groups on total score. On this test high 


significant differences 
scores indicate maladjustment; this is 
contrary to the other tests. Two of the 
scales have F values with a probability 
of less than .o1. The most discriminating 
scale is labeled Personal Inferiority*; sec- 
ond is the Social Maladjustment Scale. 
The Family Maladjustment Scale has an 
F value greater than .o1 but less than 
.o5. The Daydreaming Scale has an fF 
All of the scale 
differences are in the direction expected 
by the test author, The analysis of co- 
variance results 


value greater than .05. 


are similar to results 

* This value is spuriously high because the as 
sumption of homogeneity of the variances is not 
tenable. The results of the Bartlett test 
the Appendix the 
in this section on results in whjch the as 
sumption of 


met. 


ate re 


corded in This is only in 


stance 


homogeneity of variances was not 


/ : 
| 
a Total score 4 
Mean 39.15 35.05 2.01 
SD 9-4 8.25 7-46 
M > 61 
t 
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TABLE 23 


ANALYSIS OF VARIANCE FOR THE ROGERS TEST OF PERSONALITY ADJUSTMENT | 
Aspect of the test Source of variation df Mean square F p 
Total score Between groups 2 1009.41 14.78 <.o1 
Within groups 238 63.31 . 
Total 240 
Personal inferiority Between groups 
Within groups 238 16.42 
Potal 
Social maladjustment Between groups 2 104.07 4.92 <.01 
Within groups 238 21.1 
Potal 24 
Family maladjustment Between groups 
Within groups 238 11.57 
Total 
Daydreaming Between groups 
Within groups 238 5.06 
Potal 
rABLE 24 
ANALYSIS OF COVARIANCE FOR THE ROGERS TEST OF PERSONALITY ADJUSTMENT ; 
Variable held constant Source of variation df Mean square F p 
Intelligence lotal 230 
Within group 237 65.05 8.83 <.01 
Adjusted means 2 72.359 
Reading achievement Potal 230 
, Within group 237 68.57 12.54 <.01 
\djusted means 
Parental occupational level Total 239 
Within groups 237 68.27 13.26 <.01 
\dj isted means 2! 
obtained from most of the other tests. pation are accounted for, then the values 
When initial differences in intelligence, of F computed from total test scores show 4 
reading achievement, and parental occu- a consistent drop. In this test, however, 
they all remain statistically significant. 
ABLE 25 Che total score distributions as given in 7 
PERCENTAGES OF Eacu Ap|USTMENT Group the tabular presentation of the data 
BELOW THE MEAN OF THE OTHER . 
shows the high degree of overlap and the 
THE RoGers Test oF problems involved in using this test for 
ONALITY AD individual prediction. 
Number and percentage below the meat \n analysis of the relationship between 
Adjustment Poorly Average Well the subtests or scales of the Rogers Test 
indicates approximately zero correla- 
Poorly adjusted 24 30 - - tions. Within each adjustment group as 
described by the criterion the individual 
Well adjusted 8 69 


who scores high on one scale will not 
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TABLE 26 


CORRELATION MATRIX OF THE FOUR SCALES OF 
THE ROGERS TEST OF PERSONALITY 
ADJUSTMENT FOR EACH 
ADJUSTMENT GROUP 


Personal Social Family 


Variable Inferior- Malad- Malad- 
ity justment justment 
Personal Inferiority 
o4 .19 02 
A .04 06 
P .16 24 
Social 
Maladjust ment 
— 13 
A 
P 30 
Family 
Maladjustment 
Ww 17 
\ —.02 
P 


® Abbreviations for Well Adjusted, Average Adjusted, and 
Poorly Adjusted Groups reading from top to bottom. 


necessarily score high or low on any of 
the three other scales. Such lack of rela- 
tionship raises serious question concern- 
ing the feasibility of arithmetically com- 
bining scores on each part into a single 
or common total score. The results con- 
trast vividly with the previously pre- 
sented results of the interrelationships of 
the California Test of Personality and 
the How I Feel About Things Test. The 
parts of these tests showed subtest cor 
relations of approximately .7 and .5, for 
the three adjustment groups. This lack 
of relationship in the Rogers test merits 
more examination. 


Rosenzweig Picture-Frustration Study 

The Rosenzweig P-F Study contains 
several novelties of scoring and tabulat- 
ing. Consequently the statistical analysis 
of the results only partially follows the 
pattern of the five previous tests. The 
Group Conformity Rating (GCR) is a 
single quantitative score distributed ap- 
proximately normally for each group. Its 
meaning is similar to the scores on the 
previous tests in that the lower the score 
the more atypical the result and inter 
pretation. The previous pattern of de- 
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scriplive statistics, analysis of variance, 
analysis of covariance, and percentage of 
overlap, is followed with the GCR. 

Logically, the three scores indicating 
direction of. aggression, the three scores 
indicating type of reaction, and the nine 
scores from combining the above would 
not be expected to relate linearly to ad- 
justment status. For example, an exceed- 
ingly high intropunitive score showing 
excessive guilt feelings might be as typi- 
cal of a maladjusted child as would an 
exceedingly low score showing complete 
lack of guilt. Similarly, a balance of re- 
sponses to frustration might be more 
typical of the well adjusted boy. No such 
formal assumption is made, however, for 
in the last analysis the empirical findings 
must indicate the significance of the 
scores in terms of adjustment. Because 
of such considerations, the chi-square 
technique is used to ascertain significant 
differences between the groups for these 
variables. No analysis is made for super 
ego responses because of the infrequent 
stimulus situations. Only one trend score 
is analyzed, the change in GCR scores 
from the first to the second half of the 
test. 

There are seven incomplete or illegi- 
ble booklets despite the investigator's 
precautions. Three are from the poorly 
adjusted group, three are from the aver- 
age group, and one is from the well ad- 
justed group. The total sample used for 
statistical analysis of the Rosenzweig P-F 
Study numbers 238. 

The results of the Group Conformity 
Rating follow the findings of the previ- 
ous tests: the well adjusted group has 
the highest mean score, the groups are 
significantly different, and the score is 
related to adjustment status. The analy- 
sis of covariance indicates a slight drop 
in the F values when intelligence and 
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TABLE 27 
DESCRIPTIVE STATISTICS FOR THE GCR 
OF THE ROSENZWEIG P-F Stupy 


Adjustment groups 


Poorly Average Well 
adjusted adjusted adjusted 
Mean 13.36 14.18 14.77 
SD 2.37 2.00 2.08 
TABLE 28 


ANALYSIS OF VARIANCE OF THE GCR 
OF THE ROSENZWEIG P-F Stupy 


Source of Mean 

variation df square F p 
Between groups 2 27.64 5.88 <.01 
Within groups 235 7.07 

Total 237 


reading achievement are controlled, The 
F value rises slightly in accounting for 
differences in parental occupation. A 
graphic analysis also indicates results 
similar to findings on the previous tests. 
Each group is distributed over the same 
range and has slightly different mean 
values, but the overlapping is very great. 
Tables 27, 28, 29, and go present these 
findings. 

The GCR trend changes are analyzed 
in the following manner. A score for each 
half of the test was tabulated in making 
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TABLE 30 


PERCENTAGES OF Each ADJUSTMENT GrouP 
EXCEEDING THE MEAN OF THE OTHER 
Groups ON THE GCR OF THE 
ROsSENZWEIG P-F Stupy 


Number and percentage above the mean 


Adjustment Poorly Average Well 
group adjusted adjusted adjusted 
% N N % 
Poorly adjusted 3 38 21 35 
Average 
adjusted S4 68 37 47 
Well adjusted So Si 60 61 


up the total score. For each group it was 
possible then to determine if the value 
on the second half is higher, lower, or 
the same compared to the value on the 
first half. A nine-entry chi-square table 
was constructed. The X* of 6.24 with four 
degrees of freedom has a_ probability 
greater One that 
there is no difference in trends on the 
GCR. 


chi-square value came from the small fre 


than .05. concludes 


The greatest contribution to the 


quencies in the no-difference categories. 
The majority of each adjustment group 
tended to obtain higher ratings on the 
latter half of the test (see Vable 31). 
As discussed earlier, the scores on di- 
rection of aggression and type of reac- 
tion are grouped to account for differ- 
ences in nature of the distributions as 
well as differences in mean scores. The 
results of the chi-square analyses appear 


ANALYSIS OF COVARIANCE OF THE GCR OF THE ROSENZWEIG P-F Stupy 


Variable held constant Source of variation 


Intelligence Total 
Within groups 


Adjusted means 


Reading achievement 


Total 
Within groups 
Adjusted means 


Total 
Within groups 
Adjusted means 


Parental occupational level 


df Mean square F p 
236 
234 4.72 4.78 <.o1 


w 
— 
~ 
wn 
A 


2 22.59 
236 
236 
234 4.7! 6.25 <.o1 
2 29.42 


TABLE 31 


Cui-SQuARE TABLE FOR TREND CHANGES FROM 
THE First TO THE Last HALF OF THE TEST, 
IN Group CONFORMITY RATING SCORES 

OF THE ROSENZWEIG P-F Stupy 


Frequency 


Adjustment 


Trend changes group (o—e)? 

Higher GCR in Poorly adjusted 34 34 00 
second half Average adjusted 47 45 -00 
Well adjusted 55 57 07 

Lower GCR in Poorly adjusted 22 20 20 
second half Average adjusted 20 27 15 
Well adjusted 30 34 37 

No change Poorly adjusted 4 4 20 
Average adjusted 3 7 2.28 

Well adjusted 14 9 78 

Total 238 38 $ 


in ‘Table 32. Three of the 15 variables 
are significant at the .o5 level, none at 
the .o1 level. 

On the significant intropunitive varia- 
ble, the distribution of the poorly ad- 
justed group has a wider range, is more 
platykurtic, and tends to have more 
scores toward the low end than the aver- 
age or well adjusted groups. High intro- 
punitive scores are equally common to 
all three groups. The same type of rela- 
tionship occurs for the significant im- 
punitive variable. The distribution of 
the poorly adjusted group is platykurtic, 
has a wide range, and contains more 
scores at the low end of the distribution. 
The average adjusted group is consider. 
ably more leptokurtic. The extrapuni- 
tive-ego defensive variable, E, shows sig 
nificant differences mainly because there 
is an excess of high scores in the poorly 
adjusted group and a minimum of high 
scores in the well adjusted group. 

The same general cautiousness in in- 
terpretation of the results of the Rosen- 
zweig P-F Study is required as in the 
other tests administered, The GCR scores 
show | statistically significant different 
means for the three groups and the dis- 
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TABLE 32 


Cui-SOUARE VALUES FOR 15 VARIABLES FROM 
THE ROSENZWEIG P-F Stupy 


Variable x? df p 
Extrapunitive 6.91 8 > .O§ 
Intropunitive 13.12 6 <.05 >.o1 
Impunitive 14.28 6 <.05 >.or 
Obstacle Dominance 6.20 8 > .o§ 
Ego Defensiveness 8.33 8 >.05 
Need Persistence 7-45 6 > .05 
I 8.31 > 
I 1.92 > .05 
M’ 8 > 
I 13.08 >.O1 
I 13.35 8 > 
M 13.80 > .05 
e 0.55 Ss 
i 4.30 4 > 
m 3.090 8 > .O§ 


tributions overlap highly. Only 3 of the 
15 chi-square values, regarding direction 
of aggression and type of reaction, are 
significant and in these 3, as well as in 
the other 12, the amount of overlap of 
the distributions is so great that indi- 
vidual prediction relative to adjustment 
is hazardous. For example, extremely 
high scores or low scores may indicate the 
dynamics of the individual in responding 
to frustrating situations; however, such 
scores taken singly tell you absolutely 
nothing about an individual's school ad- 
justment status in 12 of the 15 variables 
and very little in regard to the other g. 


Relationship Among the Tests 


Because of the manner in which the 
three groups were selected it is not possi- 
ble to combine the three adjustment 
groups into a single group and compute 
the the six 
Consequently the relationships between 


the tests are computed within each adjust- 


intercorrelations for tests. 


ment group. For example, the scores on 
the California Test for the individuals 
in the well adjusted group are correlated 
with the scores on the How I Feel About 
Things Test. In the same manner the re- 
lationships between the same tests for 
the average and poorly adjusted groups 
are computed. 
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Test HIF 
California Test of Personality 
Ws .80 
A 
4 


HOW I Feel About Things (HIF) 
W 
A 


Things I Like (Likes) 
W 
A 


How Would You Finish It (S-C 
A 


» 
Rogers Test of Personality 


A 
Pp 


top to bottom. 


Inspection of Table 33 containing 
these data reveals several striking facts. 
First, the California Test of Personality 
and the How I Feel About Things Test 
are highly related. Individuals who score 
high on one tend to score high on the 
other, This is independent of the adjust- 
ment group to which they belong. This 
is to say that, in regard to the criterion 
groups, those who are false positives or 
false negatives on the California will be 
in the same category on the other test. 
This is not true on the other tests for 
the correlations are moderate to no re 
lationship at all. 


The second most striking fact is that. 


there are no other relationships that even 
begin to approach the California and 
How I Feel About Things similarity. This 
is of considerable theoretical importance, 
lor the other tests significantly relate to 
the adjustment criterion. The extreme 
difference in types of items might be of 
considerable importance in eventually 
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FABLE 33 


CORRELATION MATRIX OF THE SIX ADJUSTMENT TESTS FOR EACH ADJUSTMENT GRoUP 


Likes S-C Rogers> GCR 
23 40 33 03 
od 35 42 18 
35 20 34 o9 


12 
14 15 
os 1s 


\djusted Groups reading from 


> The Rogers Test is scored in inverted order as compared to other tests. 


building a more adequate instrument. 

Last, the results in terms of the school 
and clinical use of the tests is, in a nega- 
tive sense, quite clear, In all but one case 
mentioned above the interpretation of 
high scores on one test meaning the same 
as high scores on another test is equivo 
cal. For 


instance, those 


individuals re- 
gardless of adjustment level who have a 
high score on the Group Conformity Rat- 
ing may have a high or low score on the 
California or on the Rogers. Indications 
of maladjustment on the one is not an 
indication of maladjustment on either 
of the others. 


Summary 


The purpose of this investigation is to 
analyze the adequacy or validity of six 
tests of adjustment for children. The re- 
sults are tabulated in 


terms of statisti- 
cal significance of mean differences and 
amount of overlap of the distributions. 


Five of the tests show significant mean 


4 
19 
d .07 31 32 
P O4 34 .O4 
.20 
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differences between the three groups. 
Such findings indicate a certain degree of 
validity of the tests. Such validity is prob- 
ably most adequate for research pur- 
poses. When the effect of intelligence, 
reading achievement, and parental occu- 
pation are held constant, the F value 
usually drops slightly but generally not 
enough to lower the significance below 
the 5% level. Distributions of test scores 
reflecting amount of overlap indicate 
small practical differences between the 
groups. In some instances, the test results 
in combination with other data may be 
used with beneficial results. Use of the 
results from these tests alone for indi- 
vidual prediction, or use of any of the 
tests as a screening device, is extremely 
hazardous. 


DiIscussION AND IMPLICATIONS 


The original purpose of this investigation, as 
stated previously, is to inquire into the ade- 
quacy of several personality and adjustment 
tests for children. Adequacy might be considered 
in terms of valid prediction in such specific 
tasks as screening, contributions to case studies, 
and, research. The findings presented in the 
previous chapter show considerable statistical 
significance supporting the value of the tests in 
terms of a basic validity. Computation of per- 
centages of overlap show the hazards in making 
predictions or statements about the individual 
case from these same test results. 

The present section discusses a logical prob- 
lem, that of base rates, which accents the in- 
terpretation that the present findings are nega- 
tive. The remainder of this section analyzes 
three possible causes for the iimited validity of 
the tests: (a) the individuals selected at the 
several levels of adjustment do not really repre 
sent such groups or levels, (b) the tests them- 
selves are inadequate and do not discriminate 
because they were inadequately constructed, (c) 
the conceptual framework of level of adjustment 
indicated by single scores is inadequate and 
does not fit the actual dimensions of the situa- 
tion. Such a discussion is not an attempt to ra- 
tionalize away the findings but to indicate more 
clearly the implications of the findings in the 
areas of theory and measurement. 


The Base Rate Problem 


Meehl and Rosen (33) recently opened a 
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very crucial problem related to investigations in 
the efficacy of tests as predictors or contributors 
to diagnosis. The most succinct definition of 
the base rate problem is the title of their 
article, “Antecedent Probability and the Efh- 
ciency of Psychometric Signs, Patterns, or Cut- 
ting Scores.” They state: “Since diagnostic and 
prognostic statements can often be made with a 
high degree of accuracy purely on the basis of 
actuarial or experience tables (referred to here- 
inafter as base rates), a psychometric device, to 
be efficient, must make possible a greater num- 
ber of correct decisions than could be made in 
terms of the base rates alone” (33, p. 194). 

They discuss an example wherein a test with 
a certain cutoff score identified 55% of the 
valid positives and only 19% of the false posi- 
tives. If such a test is used in the initial screen 
ing of a large group from which 5°%%, is the 
amount of failure, the instrument would be 
79.7°% effective; however, if everyone is pre- 
dicted for good adjustment, one would be 95% 
accurate. The latter figure occurs because the 
rate of incidence based on previous experi- 
ence, records, or actuarial tables is only 5°%. 
In such a situation a test has a difficult time 
contributing toward higher accuracy of predic- 
tion or judgment. 

In the present investigation of adjustment 
tests for children, the instruments have yielded 
reliable differences in mean scores; however, due 
to the overlap of the distributions the percent- 
age of false positives is excessively high. This 
is especially true of the average adjustment 
group. When this is complicated by the fact 
that the incidence of maladjustment in children 
is defined as only a small percentage of the 
total population, 14% in the present study, the 
use of any of these tests as a preliminary screen- 
ing device, say in the fall of the year, is hazard- 
ous. The base rates of true positives are so low 
that the amount of error introduced by such 
testing would only confound the problem. 

Following logically from these points, Meehl 
and Rosen discuss a way in which test signs or 
cutoff scores can aid in prediction. They refer 
to the fact that different populations have dif- 
ferent percentages of incidence of valid positives. 
Knowledge of these varying rates or incidences 
in different groups to be examined is highly 
important. Such situations are quite typical 
when case studies are involved. 

Consider the following example. Assume that 
the incidence of maladjustment in an elementary 
school class based on teacher judgment varies 
from 5°, to 15°, of the group. Identifying such 
children poses one predictive problem. But 
maladjustment of a pupil in such a class is 
dependent on problems—those within the indi- 
vidual, those related to the teacher, those re- 
lated to the group, and those related to the 
interaction of the three factors. If an evaluation 
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of case records of referrals to the school psychol- 
ogist indicates that 50°, of the referred chil- 
dren ultimately receive psychiatric care privately 
or in an agency, the prediction problem has 
shifted. The base rate of maladjustment (mal- 
adjustment now defined as pupils receiving 
psychiatric care) is now 50 times in 100 rather 
than our previous 5 to 15 times in 100. This is 
quite a different prediction problem. The test 
which could pick up 55°, valid positives and 
only 19% false positives is now an important 
aid in determining whether the problem lies 
within the child or within the other variables 
in the adjustment equation. 

However, recall that the best single test, 
while identifying 50°, of the true positives, 
indicated 15° of false positives from the well 
adjusted group and 27%, false positives from 
the average adjusted group. In short, the base 
rate problem, the incidence of the disability in 
the population, accents the earlier interpreta- 
tion. For screening purposes these tests are de- 
cidedly inadequate. For purposes of case study 
analysis, where the base rate of maladjustment 
is nearer 50%, the tests may contribute to the 
clinician’s understanding, albeit a very limited 
amount, 


Rationale for the Findings 


At this point one is quite apt to question the 
adequacy of the three groups or levels of ad- 
justment. Are these groups, in fact, different? 
The only defense is to review the literature, the 
methods used in selecting the children, and 
independent validity estimates presented earlier. 

Whether one does or does not accept the 
groups as different, a second important con- 
sideration should still be raised. In the mono- 
graph, The Prediction of Personal Adjustment, 
Horst (22) outlines and discusses the logical and 
practical problems involved in the area of test 
construction. Basically, the six tests of person 
ality and adjustment are measurements of an 
aspect of an individual's behavior which can 
be used to predict behavior. Even though Horst’s 
analysis is in terms of prediction and resembles 
the discussion of predictive validity in the APA 
test construction manual, most of the observa- 
tions are applicable to instruments dealing with 
concurrent validity. The general construction of 
the tests can be reviewed briefly in terms of 
Horst’s analysis. This allows one to see assets 
and liabilities, at least in terms of one approach 
to measurement. Bias enters at this point, for 
Horst presents a consistent “empirical” point of 
view. 

Chapter I of his monograph gives the over- 
view of his approach: “The basic steps in the 
construction and application of predictive in- 
struments are the same for all areas of human 
activity” (22, p. 4). The five steps which he 
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outlines for the construction of a _ predictive 
instrument, in paraphrased form, are: (a) an 
index or measure of success selected—this is the 
criterion; (b) data on background factors, abili 
ties, and personality are assembled and their 
relation to the criterion is determined: those 
that show a significant relationship become pre 
dictive items; (c) these items are combined; (d) 
selected items are then crossvalidated or reap- 
plied to another sample; (¢) if the relationship 
is maintained, then the predictive factors or 
instrument can be reapplied to the population 
with a known degree of success. The above pro- 
cedures are easily interpreted in building an 
adjustment test 

Step one, the problem of obtaining a measure 
or index of success, is quite difficult. Horst com- 
ments on some of the hazards and difficulties 
involved: “First what constitutes success in an 
activity and second should a single or multiple 
criterion of success be used” (22, p. 23). In terms 
of criteria, how did the test authors define a 
maladjusted and an adjusted child? Did they 
use ratings by parents or teachers, were psychi 
atric opinions the measure, or were objective in- 
dices of delinquencies, and presence of nervous 
symptoms, the criterion measure? Or in some 
cases was there an objective criterion at all? 

In this basic first step, considerable variability 
occurs in the construction of the six tests. The 
authors of the California test did not specifically 
have groups of adjusted and maladjusted chil- 
dren for a criterion. They selected behavior 
situations which logically should reflect malad 
justment and wrote items which they felt logic 
ally would separate individuals with varying 
degrees of adjustment. Rogers had psychiatric 
ratings as his criterion measure and compared 
his test responses to these psychiatric ratings al- 
though his sample was quite smali. The Nobles 


County investigators used as their criterion a 
summary of scores of 1g tests, each with an 
unknown validity. They assumed that these 


measures each possessed a limited degree of 
validity, and then they analyzed out the items 
most significantly related to this standard. Rosen 
zweig did not begin with groups of extra, intro., 
or impunitive children. The GCR of his test 
was determined by statistical frequency of re- 
sponses in the norm group. 

The second step. the data on factors related 
to the criterion, is equally important. Much of 
the broad range of possible predictive correlates 
which Horst mentions are not possible in the 
construction of a group adjustment test. One 
is limited to verbal response, whether yes-no, 
like-dislike, more than-less than. Most impor- 
tant at this point is to obtain a wide variety of 
stimuli to which responses can be made. If 
verbal stimuli are used they should sample a 
wide range of factors: for children these might 
be attitudes toward the universal situations of 
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famiiy, parents, siblings, friends, play activities, 
and school. The factors might also be fears, 
ideals, and goals. They may relate to everyday 
activities, eating, sleeping, playing, and work 
ing. The range of variables, even on a verbal 
level, is great, and prediction is enhanced by 
allowing for breadth of initial possibilities, The 
authors of all six tests give more adequate con 
sideration to this problem. The breadth and 
variety of items and item types are consider- 
able. 

The combination of items is desirable for at 
least three reasons, according to Horst: (a) to ob 
tain the most fundamental and generally appli 
cable variables, (b) to reduce computational 
labor, and (c) to increase the reliability of pre 
diction for samples other than the first. This 
problem seems only partially handled by the 
authors of the six tests. The California test, for 
instance, is long, and the two subtests show a 
high degree of correlation, indicating some in 
adequacies of selecting test variables and com 
bining them. Tests such as the How Would 
You Finish It? and the Rosenzweig P-F Study 
when analyzed into components indicate the 
frequencies of the variables are too low to give 
basis for generalization of findings. Here the 
combinations are too severe and the tests are 
too short. 

Step four in Horst’s analysis concerns the 
problem of crossvalidation, Although much neg 
lected by test authors, this is basically a simple 
point. For example, an investigator who has 
very carefully gone through the preceding steps 
might be faced logically with the following re 
sults. An adequate criterion of adjustment may 
have been selected; the original item pool may 
have numbered a thousand items. Out of this 
the investigator may have desired a 50-item 
test. On a chance basis, 5 out of every 100 items 
would be expected to be significant. By select 
ing these items his entire 50-item test could be 
composed of chance results. Crossvalidation 
eliminates this possibility by reapplying the 
selected test items to a new sample and de- 
termining the relationships to the criterion 
After one, or more, such crossvalidation and 
selection of items the final instrument is de- 
veloped. 

This problem in construction has received 
limited attention by the test authors. The 
California Test of Personality’s nonempirical 
construction in step one precluded any cross 
validation analysis. Rogers developed his scoring 
key on 22 of his cases and analyzed the test's 
validity on the whole 52 (including the 22). The 
P-F Study received no crossvalidation analysis 
The Nobles County tests constitute a different 
category in that they are unpublished and still 
in the process of being developed. Crossvalida 
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tion in terms of concurrent and predictive va- 
lidity is in process. However, in terms of their 
present status one comment seems warranted 
In selecting the items for the How I Feel About 
Things the authors had approximately twice the 
number of items indicating statistically signifi 
cant differences beyond the .05 level between 
the extreme groups used for their item analysis. 
Rather than reapplying this whole group of 
items to a new sample they selected the 40 most 
significant items and assumed that these would 
be the most significant with any other sample. 

Step five is the application of the predictive 
instrument to the population and the determina- 
tion of its efficiency in selection, At this point 
the other uses of tests, particularly the case study 
situation where the test uses additional informa- 
tion to be combined with other information, 
enter the discussion. However, such a difference 
is one of degree rather than kind and Horst’s 
analysis applies nonetheless. Although Horst 
does not discuss this in these terms, this is the 
problem of false positives and false negatives. 
In the present discussion it is the percentage 
of the adjusted group labeled maladjusted by 
the instrument, and the percentage of malad- 
justed labeled adjusted by the instrument. Such 
continuing anatysis has been followed only in a 
limited way by the test authors. The Nobles 
County tests are still unpublished and are being 
continually evaluated. The California test and 
the Rosenzweig P-F Study receive attention by 
investigators, but the test authors have not con 
tinued this type of research on any broad scale 
The Rogers test has received little analysis be- 
yond the original monograph 

In short, each of the six tests can be given an 
a priori estimate of adequacy in terms of Horst’s 
conception of test construction. Only negligible 
attempts have been made to identify and to 
apply an adequate criterion of adjustment. Vari- 
ety of items to be used has been fairly well 
handled. The combination of items has followed 
largely a nonempirical procedure. Crossvalida 
tion is an unknown or unapplied procedure 
for several of the tests. Continuing analysis in 
the application of the tests to a variety of groups 
and populations has occurred only sparingly. 
The present investigator's opinion is that all 
of the tests leave much to be desired in their 
development and construction, The important 
unanswered question is: How much of the over- 
lap of the distributions present in the findings 
could be eliminated by a properly constructed 
test? 

Although this discussion of the results indi 


cates that the tests are not adequate for indi 
vidual prediction of adjustment, that there are 
a number of serious faults in the construction 
procedures of each of the tests, and that the 


u 


criterion groups are really different in adjust- 
ment, a further problem must be considered 
The present writer, at the beginning of the 
design formulation, was struck by several facts 

(a) the majority of the group type of children’s 
personality and adjustment tests arithmetically 
sum all items and subtests to give a single score 
reflecting the individual's “adjustment”; 
sociometric indices, also giving a set of scores 
on a single continuum, show marked relation 

ships with adjustment; (c) teacher nominations 
have frequently been used to select children 
who are adjusting well or adjusting poorly; (d) 
several conceptions of adjustment, such as Havig 

hurst’s and Symonds’, lead to the idea that there 
is a measurable state of the individual which 
varies depending on the individual's adjustment 

These influences led to the conception and ex 

ecution of the problem as has been done in this 
investigation. However, continued consideration 
of the problem plus the interesting results raised 
new issues and brought a re-evaluation of earlier 
conclusions, conclusions which had become a 
part of the design. 

The empirical findings of the present investi 
gation indicate that the tests are discriminating 
significantly, statistically if not practically, be 
tween the groups. Apparently a commonality 
within each group exists. The tests were built 
with varying approaches which raises doubts 
that an artifact of test construction produced 
the differences. Perhaps the dual criterion pro 
cedures, teacher and peer nominations, creates a 
commonality within each level of adjustment 
The consistent statistical difference between the 
groups on the tests raises the important question 
—if these tests had been more carefully con- 
structed empirically would they yield more prac 
tically valid results? 

However, some doubt exists in such an inter 
pretation, for some of the literature suggests 
diversity of types of persons appearing within 
each level. The tests with a single score indicat- 
ing adjustment may never be more than barely 
adequate because of this diversity. For instance, 
how does such a test account for two malad 
justed individuals—one with a very high degree 
of intropunitive guilt and another with very 
low or no guilt? The yes-no question when 
scored on a single key can only produce results 
which cancel each other. This is true of the 
hysteroid individual who superficially likes all 
activities on a like-dislike test and the negative 
child who dislikes every activity, in the environ 
ment. In rereading Northway's study (36) one 
finds that recessive children, socially uninterested 
children, and socially aggressive children com- 
prise the low group. Bonney (9) and Jennings 
(25) and many others find similar diversity. Re- 
reading the data on teacher nominations indi 
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cates the same phenomenon—diversity in be- 
havior, symptoms, and personality structure of 
the individuals at the different levels. This is 
the Jenkins and Glickman (24) finding also. 

In retrospect, such observations appear self 
evident, natural, and without need of argument; 
yet thousands of dollars are spent buying the 
most widely used children’s test, the California 
Test of Personality, which sums to a_ single 
score. The two subtests correlate highly, and 
the 12 scales are too unreliable for any kind of 
individual prediction. Thousands of man-hours 
are spent developing new instruments such as 
the How I Feel About Things Test, which also 
sums to give a single score 

Perhaps the most crucial problem at the pres 
ent time is not building new tests nor analyzing 
old ones but attacking the criterion problem. 
Cattell (13) has a 12-factor conception of per 
sonality. Jenkins and Glickman (24) have a five 
factor group of maladjusted children, Patterson’ 
presents another factor analysis of children re 
ferred to a guidance clinic. His groups only pat 
tially coincide with Jenkins’ and Glickman’s 
Havighurst (21) has a number of tasks which 
warrant individual analysis 

The present investigator leans heavily toward 
the building of a measuring instrument with 
multiple scales based on a conception of adjust 
ment as a multiple problem. Whether this be 
a yes-no type test with a multiphasic-like profile 
or a picture test with a multiple scoring system 
such as the Rosenzweig P-F Study cannot be de 
termined at the present time 

In discussing the findings of this investigation 
cognizance is taken of the “base rate problem.’ 
Such analysis sharply shows the limitations of 
using the six tests in certain kinds of situations 
“why 
didn’t the tests show more positive results in 
discriminating between the adjustment groups,” 


and applications. In discussing the theme 


several factors were considered, The experi- 
mental procedure was re-evaluated for errors and 
weakness, and points were indicated where more 
desirable steps could have been taken. The con- 
struction of the tests, when analyzed in terms 
of one prominent approach, show several griey 
ous errors. The rationale of homogeneity of ver 
bal behavior, symptoms, or personality within 
the adjusted or maladjusted was analyzed, and 
serious questions were raised. Implications for 
future research were drawn 


SUMMARY AND CONCLUSIONS 
The adequacy of several personality 
and adjustment tests is the subject of this 
investigation, Selection of the tests de- 


* Patterson, G. Personal communication, 1955. 
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pended on possibility of group adminis- 
tration, previously established or poten- 
tial validity, wide usage, and the repre- 
sentation of a variety of item types. The 
selected tests seem to be as satisfactory 
a group as can be obtained from the per- 
sonality and adjustment tests currently 
available. Adequacy has been referred to 
as the usefulness or validity of the tests 
as screening devices, as contributors of 
information in case studies of individual 
subjects, and as aids in research prob. 
lems. The general approach used to 
analyze the tests falls under the rubric 
“concurrent validity.” 


Summary of the Methodology 


The population sampled in this inves- 
tigation is the public school children of 
St. Paul, Minnesota. The results should 
not be generalized to nonurban groups. 
The community contains an extremely 
large nonpublic school enrollment—40% 
of the elementary school pupils. This 
introduces an atypical factor of unknown 
proportion. Fewer than half the public 
elementary schools were used in this in- 
vestigation because of sixth grades being 
platoon or being split with a fifth or 
seventh grade. No serious bias appeared 
through such a selection. The school sys- 
tem provides a special class program for 
pupils with mental and physical, both 
seausory and motor, handicaps; however, 
pupils with high ability, specific learning 
disabilities, and various emotional and 
adjustment problems remain in regular 
class. 

Each of the 37 sixth-grade teachers 
nominated several boys in his class who 
he thought were very well adjusted and 
very poorly adjusted. In this manner the 
boys in the class were automatically split 
into three groups. All the children in the 
class contributed nominations of best 
friends and classmates with whom they 
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did not get along. A hierarchy of ac- 
ceptance was established. This was arbi- 
trarily broken into thirds. A dual cri- 
terion for selection was invoked: to be- 
come a member of the well adjusted 
group a pupil must be nominated as well 
adjusted by the teacher and be in the 
top third of the peer acceptance hier- 
archy. Similarly both criteria were used 
in establishing the average and poorly 
adjusted groups. Any discrepancy in 
opinion or rating eliminated the pupil. 
A number of pupils were eliminated be- 
cause of poor reading. Several pupils 
were lost due to absence and moving. 

The sample was described in terms of 
age, intelligence, reading achievement, 
and level of parental occupation. Signifi- 
cant differences occurred on all variables 
except age. The relationship was posi- 
tive between level of adjustment and 
brightness, achievement, and high socio- 
economic status, 

Independent estimates of the validity 
of the criterion groups were made. Dil- 
ferences occurred in referrals to schools 
social workers and the child guidance 
clinic; both supported the selection tech- 
niques. Membership on the school police 
patrol is related to adjustment. The fre- 
quency of arrests is indirectly related to 
adjustment. All four estimates support 
the basic rationale. 


Summary of the Results 


The results of the tests were analyzed 
in terms of mean differences between the 
groups, the analysis of variance being 
the statistical technique. Mean differ- 
ences with intelligence, reading achieve- 
ment, and level of parental occupation 
held constant were handled with the 


analysis of covariance technique. Tables 
of percentages of overlap further indi- 
cated the nature of the distribution dif- 
ferences. 
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The three adjustment groups showed 
highly significant statistical differences 
in mean scores on the California Test 
of Personality. The groups remained 
significant when the analysis of covari- 
ance technique was used with the pre- 
viously cited three variables, The per- 
centages of distribution overlap com- 
puted using the results were quite high, 
especially in regard to the average ad- 
justed group. Although the California 
test proved as adequate as any of the 
others, it can be stated for this test as 
well as the others that using the test for 
screening purposes in a typical sixth- 
grade elementary school classroom is not 
satisfactory. The percentages of false posi- 
tives and false negatives is very high. The 
test can make a contribution, to a cer- 
tain degree, to case study analysis. The 
test is most applicable for research pur- 
poses when the purpose is to obtain 
rough comparisons between groups. The 
subtests, Personal Adjustment and Social 
Adjustment, are similar in ‘mean and 
standard deviation; they are highly cor- 
related. 

The How I Feel About Things test 
also indicated statistically significant dif- 
ferences. Holding constant IQ, reading 
achievement, and socioeconomic status 
reduced the differences, but they remain 
significant. The overlapping of the distri- 
butions was quite marked. An interpreta- 
tion comparable to that given the ap- 
plicability of the California test holds 
for this test also, 

The How Would You Finish It? test 
showed borderline statistical significance 
between the groups on mean scores. The 
Things I Like To Do test was not sig- 
nificantly different between the adjust 
ment groups in means. Slight variations 
occurred on both tests when intelligence, 
reading achievement, and level of paren 
tal occupation were held constant. The 
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probability figures fluctuated 


slightly 
above or below the 5°% level. The dis- 
tributions for the three groups on both 
tests overlapped almost completely. 
These tests do not indicate adjustment 
status of school children as adjustment 
has been” defined in this investigation. 

The Rogers Test of Personality Adjust- 
ment significantly differentiates the three 
adjustment groups. As with the other 
tests the statistical differences are over- 
shadowed by the overlapping nature of 
the distributions. The same limitations 
in applicability discussed in relation to 
the California test hold for the Rogers 
test also. 

The Group Conformity Rating of the 
Rosenzweig P-F Study shows statistically 
significant differences between the ad- 
justment groups. These differences re- 
main significant when the three descrip- 
tive variables are held constant. The dis- - 
tributions of the three groups overlap 
markedly. There are no significant trend 
changes in the GCR from the first to the 
last half of the blank. Only 3 out of 15 
variables representing direction of aggres- 
sion and type of reaction are significantly 
different between the adjustment groups. 
The chi-square technique indicates that 
the significance is at the borderline 5°; 
level in each case. 

In conclusion, it is important to re- 
peat the limits in applicability of the 
test results. Within the population limits 
discussed earlier (urban community and 
public school setting) and within the 
procedural limitations (criterion groups 
based on teacher and pupil nominations), 
the results can be applied as follows. 
None of the 


tests well 


enough to be used as a selection instru- 


discriminates 


ment for maladjusted pupils in the usual 
classroom. Several of the tests indicate 
group differences extensive enough to al- 
low for a limited amount of applicability 
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when the test data are combined with 
other information in studying an indi- 
vidual case. At least four of the tests re- 
late well enough to adjustment status so 
that their most appropriate use at the 
present time is in research. 


Summary of the Discussion 


A logical problem, in the base rate of 
incidence of the factor to be discrimi- 
nated by a test, was discussed in relation 
to the present findings. The inadvisa- 
bility of using any of these tests as a 
screening instrument when the experi- 
ence table indicates only 5% to 15°, of 
the population is maladjusted was ob- 
served. The changing base rates with a 
different subpopulation, i.e., referrals to 
the school psychologist, indicated that 
the tests could be used for limited prac- 
tical purposes. 

In analyzing the possible factors under- 
lying such basically negative, or at best 
mildly positive, findings, several prob- 
lems were considered. These are the na- 
ture of the criterion groups, the manner 
in which the tests were constructed, and 
the nature of the concept of adjustment. 
The procedures used in devising the tests 
were found to be very inadequate in 
terms of one approach to measurement 
and test construction. The inadequacies 
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were found to range all the way from 
initial analysis of the criterion to cross- 
validation and continuing analysis of the 
application of the instrument. 

The concept of adjustment was re- 
considered, Emphasis was placed on the 
probable variety of behaviors, symptoms, 
and verbalization of individuals at any 
of the three adjustment levels. Illustra- 
tions indicating some of the inadequate 
aspects of an adjustment test with a 
single summary score were given. Re- 
search oriented more toward the basic 
dimensions of adjustment was suggested. 
A test with several scales or a multiple 
scoring system seems most likely to fit the 
dimensions of the situation. 


General Conclusion 


This study approached the problem of 
the adequacy of several adjustment tests 
for children. The conceptual framework 
was that of concurrent validity. Limita- 
tions occur in the generalizability of the 
findings because of the population, pro- 
cedures, and resulting sample. These 
dimensions have been stated carefully at 
several points in the report. The nature 
of the findings indicate additional limi- 
tations; these limitations are in terms 
of applicability of the test results. 
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APPENDIX 


TEACHER NOMINATION FORM 


RESEARCH PROJECT IN ADJUSTMENT 


This is part or a project in-the identification 
and testing of adjustment in children. As was 
pointed out in the earlier letter or personal con- 
tact your name will not be associated with any 
individual pupils. All the data from the several 
schools and numerous teachers will be grouped 
for anonymity of all participants both teacher 
and pupil. Once again thanks for your coopera- 
tion. 

1. List below the three to five boys in your 
class who are the most well-adjusted. These chil 
dren get along very well with their classmates 
they like the other kids and have many friends, 
they are happy, secure, and self-confident with 
no more than normal worries, they don’t cry 
or lose their tempers easily, they are not “goody- 
good” but engage in normal child activity; they 
are not bullies, they don't fight excessively, nor 
do they shy away from other children; they do 
not fear new situations. If their present growth 
and development continues they should be well- 
adjusted, happy, useful adults. Select on the 
basis of total impression. 


Boys 


1 
2. 
3- 


2. List the boys in your class, three to five, 
who are the most severely emotionally disturbed. 
Among the things they do may be one or several 
of the following: they do not get along well with 
the other children or the teachers, they have few 
friends, they cry easily, worry a lot, are apt to 
lose their tempers, are unhappy; they fight a lot 
and bully other kids; they daydream excessively, 
don't join in activities and don’t play well, and 
they act odd. Some children may fit one descrip- 
tion or another but list the ones who you think 
are the most seriously maladjusted and emo- 
tionally disturbed, some of whom might someday 
need psychiatric help if present development 
isn't altered. Again, select on the basis of total 
impression. 


Boys 


3. List the one or two boys you haven't con- 
sidered for the above categories because you 
don't know them well enough. 


TABLE 34 


RESULTS OF THE BARTLETT TEST FOR HOMOGENEITY OF VARIANCES OF THE THREE ADJUSTMENT 


Table No. Variable 

6 Age 

6 Intelligence 

6 Reading Achievement 

6 Parental Occupation 

13 C.T.P. Total Score 

13 C.T.P. PA Subtest 

13 C.T.P. SA Subtest 

17 How Would You Finish It? 

21 How I Feel About Things 
Total Score 

21 How I Feel About Things 
Adjustment Subtest 

21 How I Feel About Things 
Adjustment- Maturity 

25 Things I Like To Do 

29 Rogers Full Scale 

20 Rogers PI Scale 

20 Rogers SM Scale 

20 Rogers FM Scale 

20 Rogers DD Scale 


Rosenzweig GCR 


Groups FOR EACH OF THE ANALYSIS OF VARIANCE PROBLEMS 


Chi square p Assumption 
18.43 <.01 Unsatisfied 
59 > .05 Satisfied 
.26 > .05 Satisfied 
> .05 Satisfied 
1.62 > .05 Satisfied 
2.12 > 05 Satisfied 
2.53 0S Satisfied 
1.60 > 05 Satisfied 
1.08 > .05 Satisfied 
> .05 Satisfied 
1.12 < .05 Satisfied 
16 > .05 Satisfied 
4.22 > .05 Satished 
6.54 > .O1 Unsatisfied 
3-75 > .05 Satisfied 
1.27 > .05 Satisfied 
64 > 05 Satisfied 


2.43 > .05 Satisfied 


1. 
3. 
4. i. 
2 
34 
29 
4 
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TABLE 35 
RESULTS OF THE L,; TEST OF HOMOGENEITY OF VARIANCES ABOUT THE REGRESSION LINE FOR 


EACH OF THE ANALYSIS OF COVARIANCE 


Table No. Variables 


14 C.T.P. and 1Q 

14 C.T.P. and Reading 

14 C.T.P. and SES 

18 How Finish and IQ 

18 How Finish and Reading 
18 How Finish and SES 

22 H.I.F. and 1Q 

22 H.1.F. and Reading 

22 H.1.F. and SES 

26 Likes-Dislikes and IQ 

26 Likes- Dislikes and Reading 
26 Likes- Dislikes and SES 

30 Rogers and IQ 

30 Rogers and Reading 

30 Rogers and SES 

35 Rosenzweig GCR and IQ 
35 Rosenzweig GCR and Reading 
35 Rosenzweig GCR and SES 


DIRECTIONS FOR PEER 


My name is Mr. Smith. Some of you know me, 
most of you probably do not, Today I'm here to 
ask your help and cooperation in a project. It is 
a survey of the friendships among boys and girls 
in the sixth grades from all over the city of St 
Paul. First let me pass out a sheet of paper to all 
of vou. 

As I said before, this is a survey of friendships 
among boys and girls from ‘all over the city. I 
want you to help me in kind of a secret ballot, a 
secret vote. All of you have a sheet of paper. On 
the top of the paper I want you to write down 
the names of the boys and girls in your room 
whom you like best of all. These are the ones 
you get along with best. You may put down all 
boys, all girls, or some of each. You may put 
down as many as you want, but most boys and 
girls usually like four or five best. Please don't 
sign your name. Go ahead. 


Write both first and last names down. If you 


can't spell the last names be sure to put the first 


PROBLEMS 


p Assumption 
.905 > .05 Satisfied 
.903 > .O5 Satisfied 
.o84 > .05 Satisfied 
903 > .O5 Satished 
> Satisfied 
-993 > .05 Satisfied 
908 > .05 Satisfied 
> 05 Satisfied 
> Satisfied 
908 > .05 Satisfied 
999 > .05 Satished 
> .O5 Satisfied 
970 > Satisfied 
g8o > .05 Satisfied 
g8o > .05 Sat sfied 
> Satisfied 
905 > Satisfied 
907 > Satished 


NOMINATIONS 
initial of the last name down. Do as best you 
can, If any of your best friends are absent today 
be sure and put their names down too. 

Is most everyone about finished? Now I want 
you to draw a line across the middle of the page 
This 
the names on {op from the 


from one side to the other. (Demonstrate.) 
is just to separate 
rest of the paper. 
Now on the bottom of the page, under the 
line, we will continue our secret vote. This time 
i want you to put down the names of the boys 
and girls that you don’t get along with very well 
These children often have difficulties with the 
other children. You may select all boys, all girls, 
or some of each. Remember, this is confidential, 
no one but me will see what name 


the paper 


you put on 
And be sure not to sign your name. 

As you finish, and take a few more minutes if 
vou need to, fold your paper in the middle so 
that the names are on the inside; I will collect 
them in this folder 
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